METHOD OF CONSTRUCTING A COMPOSITE IMAGE 



3 FIELD 

4 The field of the invention relates to the Internet and more specifically to 

5 method of constructing and transmitting images over the Internet. 

6 

7 BACKGROUND 

8 Computer networks, in general, and the Internet, in specific, have become a 

9 vast resource of information. With the aid of a personal computer (PC) and web 
10 browser, a user may connect and retrieve information on virtually any subject 

™? 11 matter. 

4) 12 Using the browser, a user can locate and access any of a number of search 

W 

pj 13 engines through the Internet. From the search engines, a webpage may be 

£7 downloaded for the entry of search terms. Through the proper entry of search 

15 terms, any range of images and text may be located and downloaded to a user. 

a 

□ 1 6 Once downloaded to a user, the user may review the information on-line or 

p 17 print it out. Alternatively, the user may store the information to disk. 

18 While the information downloaded from the Internet is useful, it typically 

|=> : = 1 9 downloaded under a hypertext transport protocol (HTTP). While HTTP is useful 

20 for storing and printing, it is not particularly easy to manipulate and combine files. 

2 1 Other protocols, such as XML, are available, but have not been developed into 

22 useful applications. Accordingly, a need exists for applications which allow for the 

23 easy manipulation and combining of web based documents. 

24 

25 SUMMARY 

2 6 A method and apparatus are provided for constructing a composite image 

27 within an image space of webpage. The method includes the steps of displaying 

28 plurality of source images within a content area of the webpage and dividing the 
2 9 image space of the composite image into a plurality of subspaces. The method 

30 further includes the steps of designating a subspace of the plurality of subspaces for 
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receipt of a selected image of the plurality of images and resizing the selected 




2 
3 


image to fit the designated subspace of the composite image. 




4 


BRIEF DESCRIPTION OF THE DRAWINGS 




5 


FIG. 1 is a block diagram of a system for constructing a composite image in 




6 


accordance with an illustrated embodiment of the invention; 




7 


FIG. 2 is login screen that may be used by the system of FIG. 1 ; 




8 


FIG. 3 is a subject matter selection screen that may be used by the system of 




9 


FIG. 1; 


Li 


10 


FIG. 4 depicts a further subject matter selection screen that may be used by 


q 


11 


the system of FIG. 1 ; 


U 1 


12 


FIG. 5 depicts a template selection screen that maybe used by the system of 


ro 

U; 


13 


FIG. 1; 




14 


FIG. 6 depicts a selected template and content area that may be used by the 


s 


15 


system of FIG. 1 ; 


Q 

j n 


16 


FIG. 7 depicts a floating toolbar that may be used by the system of FIG. 1 ; 


si 


17 


FIG. 8 depicts details of content selection that may be used by the system of 


CI 


18 


FIG. 1; 




19 


FIG. 9 depicts further details of content selection that may be used by the 




20 


system of FIG. 1; 




21 


FIG. 10 depicts content that may be used in the composite image by the 




22 


system of FIG. 1; 




23 


FIG. 1 1 depicts details of construction of the composite image constructed 




24 


by the system of FIG. 1; 




25 


FIG. 12 depicts details of image transfer to the composite image constructed 




26 


by the system of FIG. 1 ; 




O "7 
Z / 


rio. ij aepicis details me composite image constructed oy tne system 01 




28 


FIG. 1; 




29 


FIG. 14 depicts details of text transfer to the composite image constructed 




30 


by the system of FIG. 1; 
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1 FIG. 15 depicts details of creation of the composite image constructed by 

2 the system of FIG. 1 ; 

3 FIG. 16 depicts, a composite image constructed by the system of FIG. 1 ; 

4 and 

5 FIG. 1 7 depicts a screen for editing composite images that may be used by 

6 the system of FIG. 1 . 

7 Appendix I depicts a DTD that may be used by the system of FIG. 1 . 

8 Appendix II depicts a composite image file that may be generated from the 

9 composite image of FIG. 17. 
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DETAILED DESCRIPTION 
FIG. 1 is a block diagram of a system 10, shown generally under an 
illustrated embodiment of the invention, for collecting, composing and transmitting 
images through the Internet. As used herein, an image includes: an illustration; 
photo; text; multimedia components such as, but not limited to, video, hypertext, 
etc.; and/or the like. A composite image includes more than one image. 

Included within the system 10 may be an operators station 34. The 
operators station 34 may include a central processing unit (CPU) 12 with an 
appropriate web browser 32, a display 20 and keyboard 18. The operators station 
34 may also include a database 22 which may function as a source and also a 
destination of images. 

The operators station 34 may include a connection to the Internet 14. Also 
coupled to the Internet 14 may be one or more servers (e.g., CPUs) 16, including 
websites 26 and databases 24. The servers 16 may also function as both a source 
and destination of images as described in more detail below. 

Under the illustrated embodiment, an operator (not shown) working through 
the operators station 34 may access a website 26 and download a webpage 28 
containing the software constructs (e.g., a page building via browser (PBVB) tool 
30) for processing composite images. The PBVB tool 30 is a configurable tool, 
which brings page layout functionality to the Internet. Communication between the 
operators station 34 and website 26 for downloading of the P3VB tool 30 (and 
subsequent communication) may occur through the standard HTTP port 80 of the 
operators station 34. 

As described in more detail below, the PBVB tool 30 provides a facility and 
an intuitive interface for placing content within a template. Since it may be 
retrieved from a website, it is inherently simple to access from remote locations and 
easy to install. Further, since the PBVB tool 30 may be downloaded from a 
common website of an organization, the organization may more easily enforce 
business rules through the use of embedded templates. 

In general, the PBVB 30 may be written as a Java applet and run inside the 
browser 32. Providing the PBVB 30 as a Java applet allows PBVB 30 to be easily 
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used in conjunction with Microsoft Internet Explorer or Netscape Navigator 
browsers on either PC or Macintosh platforms. 

Further, to facilitate operation of the PBVB 30, data may be delivered to and 
routed from the PBVB 30 under a common format (e.g., XML). The use of XML 
simplifies image manipulation and composite image construction by providing a 
format which is Internet compatible and which is easily adapted to both text and 
image processing. 

The preparation of composite images may be useful for any of a number of 
uses. For example, the operator may use the workstation 34 to retrieve text and 
graphical representations from any of a number of Internet or local sources and 
combine such information into virtually any form of instructional or sales literature 
(e.g., catalogs). 

Following is a description of a process that may be used for the creation of a 
catalog. While the description below is directed to a specific type of composite 
image, it should be understood that the described process may be extended to 
virtually any situation. 

In order to perform construction of a composite image, the operator (after 
accessing the website 26 and downloading webpage 28 and PBVB 30) may first be 
presented with a sign-on screen 40 (FIG. 2). The operator may enter his user name 
in a first box 42 and password in a second box 44, followed by activation of a login 
softkey. 

Following sign-in to the system, the website 26 may download a webpage 
50 (FIG. 3) offering a set of file choices 52, 54, 56, 58 from which the composite 
images will be created. In the example of the catalog, the operator may activate the 
"Spring and Summer" option 58. 

In response, a further webpage 60 may be downloaded from the website 
offering subdivisions 62, 64, 66, 68 of the file selection 58. As a further example 
of the catalog creation, the operator may select "Misses" 68. 

In response, the website 26 may download a template selection webpage 70. 
Within the template selection webpage 70, a number of possible templates 72, 74, 
76 may be provided, any one of which may be used for creation of a composite 
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1 image. A scroll bar 78 may be provided to access other choices of templates. In 

2 the example provided, the operator may select the lower template 76. 

3 The templates may be divided into a number of boxes. Larger boxes may 

4 have smaller boxes inside. The smaller boxes may be text boxes and the larger 

5 boxes may be image boxes. For convenience text boxes may be shown with 

6 diagonal lines. However, this is for convenience only, in the sense that images may 

7 later be placed in text boxes and text placed in image boxes. 

8 Upon selection of a template 76, the PBVB 30 may divide the display 80 

9 into a composing screen including first and second windows 82, 84 (FIG. 6). The 
10 first window 82 may be a content area for selecting source content for the 

G ll composite image and the second window 84 displays the template within which the 

d!) 12 composite image is to be created. A floating toolbar 86 is also provided to facilitate 

pi 13 creation of the composite image. 

14 FIG. 7 provides further detail regarding the floating toolbar 86. As shown, a 

Sf 15 first icon 88 of a disk, allows the user to save the composite image. A second icon 

}*\ 16 90 allows the user to print the composite image. Third and fourth curved arrows 

17 92, 94 allows the user to UNDO and REDO changes. A selection tool 96 is 

SI 18 provided to select specific boxes of the template for insertion of content into the 

y h 19 composite image. A text tool 98 is provided to edit text in specific boxes. Zoom-in 

20 and zoom-out boxes 100, 102 and a zoom-to-percentage box 104 are provided to 

21 enlarge or reduce portions of the composite image. A help box 106 is also 

22 provided. Finally, a box select tool 108 and line selection tool 107 are provided to 

23 insert additional boxes and lines into the template. 

24 A user may click on the box selection tool 107 with a cursor 1 34 and then 

25 click on a desired location within the selected template. The location of the cursor 
2 6 134 when the key on the mouse was actuated becomes the upper left corner of a 

27 new box. The user may enlarge the box by holding the actuating key on a mouse 

28 controller and dragging the new box to whatever size needed. 

2 9 Similarly, the line tool 1 07 may be selected by placing the cursor 1 34 on the 

30 line selection icon 107 and clicking. To create lines, the user may first click on a 

31 starting position, move the cursor 134 to an end position and click a second time. 
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1 The content area 82 functions as a means for accessing source material for 

2 inclusion into the composite image. Within the content area 82, a first pull-down 

3 menu 1 10 may specify a data path to a particular data source (e.g., within a local 

4 directory, related database 22, Internet source 24, etc.). Once a source has been 

5 identified, first and second tabs 1 12, 1 14 may be used to select either text or images 

6 within the source file. 

7 In the catalog example, a user may specify a specific pathname as a data 

8 source within a remote DB 24 (FIG. 1). Files identified by the pathname may be 

9 displayed in the pulldown menu 118 (FIG. 8) of content select 110. In the catalog 
10 example, the file names may be "Specific Product", "Special Items" and "Sale". 



C 

)*{ 12 information. 



11 The user may select "Specific Product". Some choices may require additional path 



Hi 13 For example, selection of the directory name "Specific Product" may not be 

Li 14 a complete path to a file. In this case, a window 120 (FIG. 9) may be displayed 

15 requesting a specific file name. The user enters an identifier in a file identifier box 

16 122 and activates the OK button. The information entered through the file 

m 

|s' s 17 identifier box 122 may be easily customized via a configuration file. 

^( 18 Upon identification of a file, the contents of the file may be displayed in the 

tar 

M 19 content area 82. Since the image tab 1 12 is highlighted in the content area 82, 

20 images 128, 130, 132 within the file 1 1SKU#; 12345-121 1 are retrieved and 

21 displayed within the content display area 126. To accommodate the reduced size of 

22 the content display area 126, the images may be reduced or enlarged using standard 

23 Java commands. Alternately, a thumbnail image may be displayed which may be 

24 suggestive of the underlying image. 

25 To create the composite image, the user may place a cursor 134 on an image 
2 6 (e.g., 128) and drag the image to a box (e.g., 136). When the cursor 134 is released, 

27 the 10 PBVB 30 resizes the image 128 to occupy the box 136 using standard Java 

28 commands. The outline of the box 136 disappears and the resized image 138 

29 appears in its place (FIG. 1 1). 

30 Since the image 138 was placed in a first box 136 of the larger box 142, the 

31 PBVB 30 may now assume that the second smaller box 140 is a text box. To select 
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1 text to add to the composite image, the user may either click on the box 140 or 

2 select the text tab 114. 

3 Selection of the text tab 1 14 (FIG. 12) causes any text sections 142, 144, 

4 146 associated with the file to be presented in the content area 82. As with images, 

5 the user may place the cursor 1 34 over a text section and drag the text (e.g., 144) to 

6 a box (e.g., 140). Alternatively, the user may first click on the box 140 and then 

7 simply click on the text section 144 to affect a transfer. As with the images, the 

8 text section 144 may be resized to fit the box of the composite image (FIG. 13). 

9 Once text has been dragged to a box the user may edit the text. 

10 Alternatively, the user may edit the text 144 file in the control area 82. The user 

vf ] 1 1 may edit the text by selecting the text tool 98 or he may select the text by double- 

jt= 12 clicking on the text. Once the text tool has been selected, the user may place the 

Rl 13 cursor 134 in the proper location in the text and make any necessary changes. 

ui 

fa 14 To facilitate entry of information into the composite image 148, the user 

15 may select the zoom-in tool 150 (FIG. 14) and enlarge a particular box 152. In 

Cl 16 response, the box 152 (FIG. 15) may be enlarged to occupy the entire right window. 

el 

fa 17 Image and text may be dragged and dropped as above. As each box 152 (FIG. 1 5) 

Si 

^1 18 is completed, the user may return to the template by selecting the zoom-out tool 

^ 19 100. 

20 Using the process described above, the entire composite image 148 may be 

21 completed as shown in FIG. 16. Upon completion, the user may select the save 

22 icon. 

23 Upon selection of the save icon 88, the composite image 148 may be converted into 

24 an XML document and stored or printed. The XML document may be stored in a 

25 local database 22, transmitted under XML to a website 26 or stored in a remote 

26 database 24. 

27 The transfer of data into and out of the PBVB 30 may be accomplished 

28 under any of a number of different formats. The source information (text and 

29 images) provided to the PBVB 30 may be provided under any appropriate mark-up 

30 language (e.g., XML) from any of a number of information conversion utilities 
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(e.g., DeskNet APS). Images may be further encoded under an appropriate image 
format (e.g., gif, jpeg 3 etc.). 

Composite images may be encoded by PBVB 30 into a composite image file 
21, 29 under a webpage format for transmission, printing or storage in an 
appropriate database under a mark-up language structured to minimize composite 
file size, yet maximize file conversion efficiency. Appendix I provides an example 
of a document type definition (DTD) that may be used in conjunction with XML as 
an encoding mechanism for the composite image. 

As may be noted from the DTD information of Appendix I, the information 
of the composite image maybe encoded under XML based upon position and any of 
a number of text and picture elements. The x position (xpos), y position (ypos) and 
width and height of each box of the original template of the composite image 148 is 
required. Text may be attached to text boxes using conventional XML formatting. 
Lines, font or shading may be imparted to the composite image 148 using the DTD 
and conventional XML formatting. 

As may also be noted from the Appendix I the DTD allows images or text to 
be identified by a universal resource locator (URL). The utility of using a URL for 
an image (or for text) is that the actual image does not necessarily have to be stored 
within the composite image file. As such, the composite image file 21, 29 may 
simply be transferred in the form of a shell with references to source files. When 
the composite file reaches its destination, a browser may simply retrieve the 
information from the URL and insert it into the proper location of the composite 
image 148. 

As is clear from Appendix I, the composite image file 21, 29 may be 
structured without any text or image information within the file. The composite 
image file 21, 29, in fact, need only contain a page layout with paths to the image 
and text necessary for rendering the composite image into the same visual 
appearance presented to the original user during creation of the composite image. 

Within a destination (e.g., another CPU 16), the composite image 148 may 
be reconstructed based upon the composite image file 29 and the DTD 27. To 
recreate the composite image 148, a decoding processor 23 (e.g., a browser) may 
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1 retrieve the composite image file 29 from a database 24. The decoding processor 

2 23 may reconstruct the template using the composite image file 29 and DTD 27. 

3 Any images not contained within the file 29 may be retrieved using the URL within 

4 the composite image file 29. 

5 FIG. 1 7 depicts an editing screen that may be generated by the PBVB tool 

6 30 for editing composite screens. As with the composing screen of FIG. 6, the 

7 editing screen may include a content area 82 and an image area 84. 

8 To facilitate editing of existing (or the generation of entirely new) 

9 composite images, the content area 82 may include tabs allowing selection of 

10 images, text or templates. In the case of the editing screen of FIG. 1 7, the template 

CI 11 tab 160 may be used to retrieve pre-existing composite images. 



>^f I 12 By selecting the template tag (and entry of an appropriate path identifier), a 

\ : ) 

^ 13 number of previously created composite images 162, 164, 166 may be displayed in 

111 14 the context area 82. To select a composite image 162, 164, 166, the user may place 

\\ 15 the cursor over the image and activate the selection switch, 

p 16 In response, the selected composite image 162, 164,. 166 may be displayed 

0i 17 in the image area 84. Once an image has been selected, the user may select the 

M 

\\ 18 image or text tab (FIG. 1 8) and edit the selected composite image. Editing may 

j^J 19 occur by selecting the text tool and typing in corrections, add new boxes, change 

20 box size (all as described above), or substitute new content. New content may be 

21 substituted by dragging new content into the space of existing content. When this 

22 is done, the new content completely replaces the old content. 

23 Turning now to the composite images, an example will now be provided 

24 regarding the structure and content of the composite image files 21, 29. Appendix 

25 II may be representative of a CEF file 2 1 , 29 that may be generated by the PBVB 
2 6 tool 30 from the composite image 168 of FIG. 17. 

27 For ease of understanding the content of Appendix II, line numbers have 

28 been added along the left margin of FIG. 17. Reference shall be made to the line 

29 numbers as appropriate to understanding the relationship between CEF files 

30 elements and corresponding elements of the composite image 168. 
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1 


As may be noted, line 1 defines the type of CEF 21, 29 file by version and 




2 


the term "encloding-'lininl" defines an XML character set. Line 3 provides a URL 




3 


to a relevant DTD 27, 3 1 . Line 5 provides a layout delimiter. Line 6 provides a 




4 


page number of the composite image and a size of the page in points (e.g., 72 points 




5 
6 


per inch). 

Lines 7-18 defines the first element 170 of the composite image 168. As 




7 
8 


shown on line 7, the element 1 70 is a text box. The x and y position (i.e., xpos and 
ypos) of the upper left corner of the box lies at 225 and 643.252, respectively. The 




9 


width is 365.7266 and the height is 21 .2385 points. The box can be edited, 




10 


therefore canEdit- 'true". The term xpos=0, therefore other boxes may overlap the 


q 


11 


first element 170. The runaround terms (e.g., rounaroundleft, runaroundright, 




12 


runaroundtop, runaroundbottom) specify a border space around the element 1 70. 


w 

m 


13 


Line 12 defines the end of the text properties. Lines 13-15 specify font and style. 


m 


14 


Lines 16-17 specifies the actual text to be placed within the element 170. Line 18 


15 


defines the end of the text element 170. 


5 s3 % 


16 


Lines 20-27 defines the location and content of a picture box 172. As may 


m 


17 


be noted, line 26 provies a URL to the actual image information to be inserted into 


Sit 


18 


the picture box 172. 


C) 


19 


Similarly, lines 28-35 defines image element 196 and lines 36-47 defines 




20 


text box 1 82. Line 48 to the end of page 1 and lines 1-6 on page 2 of Appendix II 




21 


define text box 184. Lines 8-19 defines empty box 178, lines 20-27 defines image 




22 


element 174 and lines 28-35 defines picture box 180. 




23 


Line 36 to the end of page 2 and lines 1-9 of page 3 of Appendix II defines 




24 


the location and content of large text box 188. Lines 10-21 defines text box 188, 




25 


lines 22-33 defines text box 190, lines 34-45 defines text box 192. Line 42 to the 




26 


end of page 2 and lines 1-11 on page 4 defines text box 186. 




27 


It should be noted that elements 172 and 174 have a lower zpos value than 






plpmpnt's 1 Thp Iowpt 7nn<? v?i1iip<5 nfplpnipnt*; 1 79 anH 1 74. irlpntifv thpcp 




29 


elements as lying on top of (instead of underneath) element 188. 




30 


A specific embodiment of a method and apparatus for constructing 




31 


composite images according to the present invention has been described for the 
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purpose of illustrating the manner in which the invention is made and used. It 
should be understood that the implementation of other variations and modifications 
of the invention and its various aspects will be apparent to one skilled in the art, and 
that the invention is not limited by the specific embodiments described. Therefore, 
it is contemplated to cover the present invention and any and all modifications, 
variations, or equivalents that fall within the true spirit and scope of the basic 
underlying principles disclosed and claimed herein. 
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